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Get the Haskell lib.: cabal install testing-feat 



Example 



*Main> index (10 100 ) :: ([[Boo/]], [Bool]) 
([[],[],[ False, False, True, True], ...[ False], []], 
[ True, True, False, False]) 



Property Based Testing of large AST types 



Use case: test pretty-print + parse for Template Haskell, 
data Exp = VarE Name \ CaseE Exp [Match] | ... -- 18 Con 
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Property Based Testing of large AST types 



Use case: test pretty-print + parse for Template Haskell, 
data Exp = VarE Name \ CaseE Exp [Match] | ... -- 18 Con 

data Match = Match Pat Body [Dec] 



data Pat = LitP Lit \ ViewP Exp Pat\ ... - 14 Con 

data Body = GuardedB [(Guard, Exp)] \ NormalB Exp 

data Dec = FunD Name [Clause] \ ... — 14 Con 



data Clause = Clause [Pat] Body [Dec] 
Around 10 datatypes, around 100 constructors. 



Enumerating by size 



Enumeration of [Boo/] 
{ [] , [False] , [ True] , [False, False] , [False, True] . 

index 0 i->- [ ] 
index 1 i-> [False] 
index 2 i— >• [ True] 



Partitioning by size 



Partitioning of [Bool]: 

{ 

{ } , 0 Constructors 

{ [] }, 1 Constructor 

{ } , 2 Constructors 

{[False], [True]}, 

{}, 

{ [False, False] , [False, True] ... 
An infinite sequence of finite sequences 



Spec, of functional enumerations, part 1 



type E a — fun. en um. of values of type a 
type Fa — similar but for finite enum. 

sel :: E a — > Part — > F a — pick one finite enum. 
card :: F a — > IN — get its cardinality 

index F :: F a — > Index — > a — ... and its elements 
— where Part = Index = IN 
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type E a — fun. en um. of values of type a 
type Fa — similar but for finite enum. 

sel :: E a — > Part — > F a — pick one finite enum. 
card :: F a — > IN — get its cardinality 

index F :: F a — > Index — > a — ... and its elements 
— where Part = Index = IN 

Possible implementations of F and E\ 

type F a = (IN, Index — > a) — we will use this 
type F' a = [a] — not this 

type E a = [F a] — but we use (roughly) this 

type E' a = Part — > F a — not this 



Spec, of functional enumerations, part 2 



Set operations for E and for F: 

empty : : E a 

sing : : a — > E a 

(0) v.E a—> E a—> E a 

(®) v.Ea^E b^E(axb) 

pay : : E a — >• E a 

/map ::(a ->• 6) -)• E a ->• E 6 

empty : : F a 

sing F : : a — > F a 

(0 F ) \:F a-> F a-> F a 

(<8) F ) ::F a^ F b^ F (ax b) 



merge two enum.s 
diagonalisation 
increase cost (size) 



Example enumeration of a simple datatype 



data T = L\ST\BTT 



instance Enumerable T where 
enumerate = pay (pure L 

© pure S ® enumerate 

© pure B ® enumerate ® enumerate) 



[(o,m, 

(Us*.]), 

(2,[S(SL),BLL\), 

(4, [S (S (S /.)), S(BLL),BL(SL),B (S L) L]) 



Spec, of functional enumerations, part 3 



sel : : E a — > Part — > F a 
sel (pay e) 0 = empty 
sel (pay e) (p+ 1) = sel e p 

sel empty p = empty 

sel (sing x)0 = sing F x 
sel (sing x) (p+1) = empty F 

sel (a®b)p = sel a p © F sel b p 

p 

sel (a 0 b) p =0 (sel a k ® F sel b(p-k)) 



Functional finite sequences 



data Finite a = F 
{ card F : : Integer 

, index F :: Integer — > a} — between 0 and card F — 1 



Functional finite sequences 



data Finite a = F 
{ card F : : Integer 

, index F :: Integer — > a} — between 0 and card F — 1 

Finite a « [a] 
carc/ F « length 
index F « (!!) 



empty : : Finite a 
empty F = FO(A/"-»_L) 

s/ng F : : a — > F/'n/te a 
s/ng F a = F 1 one where 

one 0 = a 

one _ = _L 



empty ~ [ 
s/ng F «(:[]) 



map F :: (a — > b) — > Finite a — > Finite b 
map F f (F c ix) = F c (f o ix) 



(© F ) :: Finite a — > Finite a — > Finite a 
fl © F f2 = F car ix where 
car = card F fl + card F f2 
ix i = if / < card F fl 
then index F fl i 
else index F f2 (/' — card F fl) 

(e F ) w (+f) 

(xs -H- ys) ! ! / = xs ! ! / for i < length xs 

= ys ! ! (/ — length xs) for i ^ length xs 



fl (g) F f2 = F car ix where 
car = card F fl * card F f2 
ix i = let (d, m) = (/' 'divMod' card F 
in (index F fl d,index F f2 m) 



[(x,y) | x xs,y <— ys] « xs 0 F ys 

[(x,y) |x^xs,y^ys]!!/' = 
(xs ! ! div i lys, ys ! ! mod i lys) 
where lys = length ys 



Infinite enumerations 



newtype Enumerate a = E { parts :: [Finite a] } 

— Actual implementation also store 

— the reversals of all initial segments of the list 



empty :: Enumerate a 
empty = E (repeat empty F ) 

sing : : a — > Enumerate a 

sing a = E {[sing F a] 4f repeat empty F ) 

fmap v. (a — >• 6) — > Enumerate a — > Enumerate b 
fmap f = E o fmap [map F f) o parts 



:: Enumerate a — > Enumerate a — > Enumerate a 
el e2 = E% zipWith (0 F ) (parts el ) (parts e2) 



Each part of a product is a finite convolution 

(ei <8> ez) ! n 

= ei ! 0 ® F e2 ! n 
0 F ei!l ® F e 2 !(n-l) 

e F ... 

e\ ! n ® F e2 ! 0 
= concatp 
(zipWith (<g) F ) 
(parts ei) 

(reverse (ta/ce n (parts e2)))) 

e ! n = parts e ! ! n 

concatp = /b/c/r (0 F ) empty F 



(0) :: Enumerate a — > Enumerate b — > Enumerate (a, b) 
xs ® ys = E $ map (com/ (parts xs)) 

(reversals (parts ys)) 

com/ :: [Finite a] — >• [Finite b] — > F/n/'te (a, 6) 
conv xs ys = concatp (zipWith (<g) F ) xs ys) 

reversals :: [a] — >• [[a]] 
reversals = go [] where 
go rev (x : xs) = let rev' = x : rev 
in rev' : go rev' xs 



Assigning costs 



pay :: Enumerate a — > Enumerate a 
pay e = E $ empty : parts e 



Assigning costs 



pay :: Enumerate a — > Enumerate a 
pay e = E $ empty : parts e 

Guarded recursion operator: 

fix pay — empty 



Examples 



en um Bool = P a Y $ sing False © sing True 



*Main> map card F (parts enuniBool) 
[0,2,0,0,0,0... 



Examples 



data N = Ze\ Su N deriving Show 
enurriN = pay $ sing Ze © fmap Su enum^ 

*Main> map card F (parts enum^) 
[0,1,1,1,1,1,1,1,1,1,1... 



Examples 



enum [Bool] = pay$ 
sing[]@ 

fmap [uncurry (:)) (enum Booj ® enum^ Bool ^) 

*Main> map card F (parts enum^ Boo n) 
[0,1,0,2,0,4,0,8,0,16,0,32,0,64,0,128,0,256,0... 



Absolute indexing 



index' :: Enumerate a — > Integer — > 
index' = index F o concatp o parts 



Absolute indexing 



index' :: Enumerate a — > Integer — > 
index' = index F o concatp o parts 

Consider: 

length [repeat ()) = _L 
repeat ()!!/' = () 



Random selection 



uniform p :: Finite a — > Gen a 

uniform p f = HftM (index F f) (choose (0, card F 



Random selection 



uniform p :: Finite a — > Gen a 

uniform p f = HftM (index F f) (choose (0, card F f 



uniform :: Enumerate a — > /nt — > Gen a 

uniform e n = uniform p $ concatp $ ta/ce n $ parts 



• An algebra of Functional Enumerations 

a Concise definition (complete implementation in slides) 
« Nice algebraic properties 

• Automatically derivable for algebraic data types 



• An algebra of Functional Enumerations 

a Concise definition (complete implementation in slides) 
« Nice algebraic properties 

• Automatically derivable for algebraic data types 

• Actually finds bugs 

• Particularly useful for large abstract syntax tree types 

• Found errors in haskell-src-exts and template-haskell 

• Neither SmallCheck nor QuickCheck finds these bugs 
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Thank you! 



